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Abstract 

Whenever we have a group acting on a class of functions by translation, the bispectrum offers 
a principled and lossless way of representing such functions invariant to the action. Unfortu- 
nately, computing the bispectrum is often costly and complicated. In this paper we propose a 
unitarily equivalent, but easier to compute set of invariants, which we call the skew spectrum. 
For functions on homogeneous spaces the skew spectrum can be efficiently computed using some 
ideas from Clausen- type fast Fourier transforms. 

1 Introduction 

Given a function /: M. — > C with Fourier transform /, it is well known that the bispectrum 

q(h,k 2 ) = f(k 1 )f(k 2 )f(k 1 + k 2 ) k u k 2 GR (1) 

is invariant to translations of /. The bispectrum is used in various signal and image processing 
applications which involve translation invariance. 

Kakarala generalized (T1J to signals on a wide class of non-commutative groups, including all 
compact, and thus, all finite groups. On a group G the (left-) translate of /: G — > C is defined 
f l (x) = f(t~ 1 x), and the bispectrum takes the form 



KPi,P2) = {f(pi)®f(P2)y c, 



t 

P1P2 



©/(p) 



( 2 ) 



where pi,p 2 and p are irreducible representations of G, and C PlP2 are the Clebsch-Gordan matrices. 
Recall that the Fourier transform on a non-commutative group is a collection of matrices indexed 
by the irreducible representations. The remarkable fact shown by Kakarala is that for a wide class 
of groups the bispectrum is not only invariant to left translation, but, assuming that each Fourier 
component f(p) is invertible, the q(pi,p 2 ) matrices also uniquely determine / up to translation 



[Kakarala . 1992 . Theorem 3.2.4]. In other words, given /, /': G — > C and their respective bispectra 



(oiPuP2)) pltP2 and (<f(pi,P2)) pi>/32 , we have q(pi,p 2 ) = q'(pi,p 2 ) if and only if f(x) = f(t 1 x) for 
some t € G. 
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Unfortunately, the bispectrum can be difficult to compute, even on finite groups of moderate 
size. The total number of entries in the q{pi, P2) matrices is | G | 2 , which can be a problem. Another 
issue is the difficulty of deriving the form of the Clebsch Gordan matrices for non-trivial groups. 
Finally, computing ([2]) is expensive because it involves the multiplication of large matrices. These 
factors all limit the practical applicability of the bispectrum method. 

In this paper we introduce the skew spectrum, which furnishes an alternative set of invariants. 
The skew spectrum can be computed by Fourier transformation alone, without any explicit Clebsch- 
Gordan transforms. We show that the skew spectrum is unitarily equivalent to the bispectrum. 
In particular, the skew spectrum is sufficient to uniquely determine the original function / up to 
translation. 

An important generalization of the above is when / is not a function on G itself, but a function 
on a homogeneous space of G. This case is likely to be more relevant to applications than the original 
case of functions on G. The new invariants can be restricted to a wide range of homogeneous spaces, 
and are closely adapted to Clausen-type FFTs, offering computational economy. 

2 Fourier transforms and the bispectrum 

In this paper G denotes a finite group of cardinality | G | and 1Z denotes a complete set of inequivalent 
irreducible complex-valued matrix representations of G. Since G is finite, 7Z is a finite set. We use 
the letter p to denote the individual irreducibles, and d p to denote their dimensionalities. Thus, 
each p G 1Z is a homomorphism p: G — > C d P xd p. Without loss of generality, we assume that all 
p G 1Z are unitary, i.e., = (p(x))^ 1 = p{x)^ . 

We denote the set of complex valued functions on G by L(G). Given / G L(G) and a group 
element t, the left-translate of / by t is the function /* G L{G) defined f l {x) = f(t x). A 
functional p: f 1— > p(f) is said to be invariant to left translation (or just left-invariant for short) 
if p{f) = f° r an Y / ^ L(G) and any t G G. A set P = {pi,P2, ■ ■ ■ ,Pk} of such invariants is said 
to be complete if pi(f) =Pi{f), • • • , Pk(f) = Pk{f) implies /' = /* for some t G G. The objective 
of this paper is to find an efficiently computable yet complete set of left-invariant functionals. 

2.1 The Fourier transform 

The Fourier transform of a function / G L(G) is the collection of matrices 

f(p) = ^2p(x)f(x) pen. 

x&G 

With respect to the norms 

II / f = rjjr E I /(*) I' and II / II 2 = 77772 E d P II fiP) II I 
1 1 x&G I u I pell 

1 /2 --- 

(where || M || 2 denotes the Frobenius norm (Y17j=l ) * ne transform f 1— > / is unitary, 

and its inverse is given by 

= T^]Y, d P tr 0°(*) • f(p)) x <E G. 

' ' pen 
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Defining the convolution of two functions f,g£ L(G) as 

(f*9) fa) = ^/(xy-^giy), 
y&G 

it is easy to verify the convolution theorem / * g(p) = /(p) ■ g(p). Another property of interest is 
the behavior of the Fourier transform under translation: 

?(p) = £ P (x) f(t- i x) = m = p(t) pi*) m = p® ■ f(p)- (3) 

x£G xGG xGG 

Finally, defining /~ G L{G) by f~{x) = fix" 1 ), and letting * denote complex conjugation, we have 

T-{p)* = Kp) ] . 

In general, we say that a matrix-valued functional F: L{G) — > C Dxdp is p-covariant if = 
p(t) • for any / <E L(X) and any t G G. Similarly, F': L(X) -> C dpXd " is p-contravariant 

if F'if 1 ) = F'if) ■ p(t)^. Clearly, the adjoint (conjugate transpose) of a p-covariant functional is 
p-contravariant . 



2.2 The power spectrum 

If F is p-covariant and F' is p-contravariant, then Q(f) = F'if) F(f) is invariant, i.e., = 
Qif). Thus, the matrices a(p) = /(p)^ /(p) are a natural starting point for finding left-invariant 
functionals. On closer inspection, the invariance of a should not come as a surprise, since by the 
convolution theorem a is the Fourier transform of the autocorrelation 

<x) = £ nxy- 1 )* ny) = /(^ _1 r m, 

yeG y&G 

which is manifestly invariant to left-translation. We call (a,(p)) ^ the power spectrum of /. 

Unfortunately, the matrix elements of (a(p)) pG 7^ fall short of forming a complete set of invariants. 
This is because the spectrum is insensitive to the relative "phase" of the various Fourier components. 
The natural way to couple the components is to take tensor products, forming higher order spectra. 

2.3 Triple correlation and the bispectrum 

Recall that for any pi, pi G 1Z, the tensor product representation p\®pi decomposes into irreducible 
components in the form 



(Pi ® P2)ix) = plix) (g> p 2 (x) = C 



P1P2 



0p(z 



L pen 



CU, (4) 



where C PlP2 is a unitary matrix called the Clebsch-Gordan matrix, m p = m(pi,p2,p) £ Z + is 
the multiplicity of p in the decomposition, and M® k is a shorthand for ®f =1 M. 

Now consider the tensor product of the Fourier matrices /(pi) and fipi)- Under translation 

/(Pi) ® /(p 2 ) -> ?(pi) ® ?(p 2 ) = (pi(t) ® p 2 (i)) • (/(Pi) ® /(p 2 )), 
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hence 



J P\P2 



©P(t) 0m " cl 1P2 (f( Pl )®f( P2 ))c plP2 . 

pen 1 



cl P2 {Hpi)®Hp2))c p 

We say that C\ lP2 (/(pi) <8> /(/O2)) Cpip 2 i s 0p /0® mp -covariant. In particular, the bispectrum 



b(pi,p 2 ) = (/(pi) ®/i>2)) + C, 



P1P2 



©/O) 

p67£ 



©nip 



rrt 

Plp2 



(5) 



is invariant to left-translations of /. The remarkable fact proved by Kakarala for compact groups 
in general is that provided that all f(p) are invertible, t he matrix eleme nts of (b(pi , P?.)) ni :P Q^v. 
are not only invariant, but also complete Kakarala . 1992 . Theorem 3.2.4] [Kakarala . 19931 H It is 
possible to construct even higher order spectra, but there is no need: the bispectrum is already 
complete. 

It is natural to ask what the analog of the autocorrelation is, i.e., what invariant function the 
bispectrum is the Fourier transform of. To answer this question we consider functions on the direct 
product group GxG. Recall from general representation theory that the irreducible representations 
of G x G are the tensor products of the irreducible representations of G. Thus, 

f{pl)®f(p2)= Y Y (pl( X l)^P^2))f(xi)f(x 2 ) 
x\eGx 2 eG 

in ([5]) is the Fourier transform of u(xi,x 2 ) = f{xi) f(x 2 ), while 



C, 



P1P2 



©/or p ci 1P2 = j:c plP2 ©p»^ 



■pen J 
is the Fourier transform of 



xeG 



■ pen 



C U P 2 f( x ) = Y 0i(*) ® P2(x)) /(a 



xeG 



v(xi,x 2 ) 



f{x\) if xi = x 2 
otherwise . 



Thus, by the convolution theorem (on GxG), ([5]) is the Fourier transform of « * v , where 
u~(xi,x 2 ) = u{x^ , X2 )■ In long hand, the bispectrum is the Fourier transform of 

Y Y u '(xiyi 1 ' 00 ^ 1 )* vivify?) = Y ^2 '"'(y^i^y^x^ 1 )* v{yi,y 2 ) 

yieGy 2 eG yieGy 2 eG 

= Y fiy*! 1 )* fiyx^T f(y) = b (x u x 2 ) , (6) 

yeG 

which is known as the triple correlation of /. Just as the bispectrum, provided that all Fourier 
matrices are invertible, the triple correlation also furnishes a complete set of left-invariant func- 
tional of /. In fact, Kakarala derives the concept of bispectrum from the triple correlation, and 
not the other way round. 



1 Kakarala defines the bispectrum in a slightly different form, equivalent to {(Sj up to unitary transforms and 
complex conjugation. 
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2.4 Computational considerations 



The price to pay for the completeness of the bipsectrum and the triple correlation is their inflated 
size. Letting |G| denote the cardinality of G, the triple correlation consists of \G\ 2 scalars. By the 
unitarity of the Fourier transform the total number of entries in the bispectrum matrices is the 
same. The symmetry b(xi, x 2 ) = b(x 2 , x±) and its counterpart b(p±, p 2 ) = b(p 2 , p±) (up to reordering 
of rows and columns) reduces the number of relevant components to |G|(|G| + l)/2, but to keep 
the analysis as simple as possible we ignore this constant factor. Another technical detail that we 
ignore for now is that if all we need is a complete set of invariants, then we can use the matrices 
b (pi) P2) C PlP2 instead of b (pi, p 2 ), sparing us the cost of multiplying by Cj, lP2 in ([5]). 

The cost of computing the bispectrum involves two factors: the cost of the Fourier transform, 
and the cost of multiplying the various matrices in ([5]). Recent years have seen the emergence 
of fast Foruier transforms for a series of non-commutat ive groups, i ncluding; the symmetric group 
Clausen, 1989 ]. wreath product groups Rockmore . 1995 ], and others Maslen and Rockmorel . 19971 ] . 



Typically these algorithms reduce the complexity of Fourier transformation (and inverse Fourier 
transformation) from 0(|G| 2 ) to 0(|G| log fc |G|) scalar operations for some small integer k. In 
the following we assume that for whatever group we are working on, an 0(|G| log fc |G|) transform 
is available. This makes matrix multiplication the dominant factor in the cost of computing the 
bispectrum. 

The complexity of the naive approach to multiplying two D-dimensional matrices is D 3 . Using 
the well known fact that ^pg-K^p = I C I (which can be regarded as a corollary to the Fourier 
transform being an invertible linear map), the cost of computing ([5]) for given (p±,p 2 ) is 0{d? pi d 3 p2 ). 
Summing over all pi, p 2 € 1Z and assuming that ^peTC grows with some power 1 < 9 < 2 of \G\ 
(note that even Ylp^n^p S rows with at most \G\ 2 ) gives an overall complexity bound of 0(\G\ 2e ). 
Thus, the critical factor in computing the bispectrum is matrix multiplication and not the fast 
Fourier transform. 

As for the triple correlation, (|6|) involves an explicit sum over G, which is to be computed for 
all I C 1 2 possible values of (x±,x 2 ), giving a total time complexity is 0(|G| 3 ). 

One should note that when unique identifiability of / is not an absolute necessity, it is possible to 
truncate / according to some "low pass filtering" scheme in the interest of computational efficiency. 
This is easy to implement in the bispectrum, but not in the triple correlation. 



3 The skew spectrum 

The computational demands of the triple correlation and the bispectrum are of serious concern in 
applications. The former involves an explicit summation over G for each (x±,x 2 ) pair, while the 
latter involves multiplying together large matrices and the non-trivial issue of computing Clebsch 
Gordan coefficients. In this section we derive a third, unitarily equivalent, set of invariants, which, 
in some sense are a combination of the two. 

Our starting point is the collection of functions r z : G — > C indexed by z £ G and defined 

r z{x) = f{x)f(xz). 

Introducing the concept of left z-diagonal slice g\ z (x) = g(x,zx) and right z-diagonal slice 

9 iz ( x ) = g(x,xz) of a general function g: G x G — > C, and recalling our previous definition 
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u(xi,X2) = f{x{)f(x2)i we may write r z = u[ z . The r z {p) Fourier components are p-covariant 
(with respect to the action of G on /), since 

r z \p) = E W' 1 *) f(t~ lxz ) = E K x ) ^ xz ) = P& ■ ? *(P)- 

x€G x&G 
This immediately gives rise to the left-translation invariant matrices 

Up) = r z {p) ] -Kp) P^K. (7) 

The collection of matrices {Qz(p)} p& ^i z& g we can ^he skew spectrum of /. 

To see that the skew spectrum and the bispectrum are unitarily equivalent, it is sufficient to 
observe that by the convolution theorem 

iz(x) = E ^{xy' 1 )* f(y) = E r z(y x ~ l T f(y) 

y<=G y£G 

= E fiy^ 1 )* fiv^T f(y) = z ~ lx ) = H z -^\ 

yeG 

and that {b\ z } z£ q together make up the triple correlation b. We thus have the following theorem. 

Theorem 1 Let f and f be complex valued functions on a finite group G and let 1Z be a complete 
set of inequivalent irreducible representations ofG. Assume that f(p) is invertible for all p € 1Z. Let 
the skew spectrum q z be defined as in Then f = f for some t £ G if and only ifq' z (p) = q z (p) 
for all z € G and all p £ 7Z. 

From a computational perspective, the skew spectrum involves |G| + 1 separate Fourier trans- 
forms followed by |G| sequences of multiplying {C dpXdp }p^Ti matrices. Using the notations of the 
previous section, the cost of the former is OdGj 2 log fc | G | ) , while the cost of the latter is 0(\G\ e+1 ), 
improving on both the triple correlation and the bispectrum. 

4 Homogeneous spaces 

Real world problems often involve functions on homogeneous spaces of groups as opposed to func- 
tions on the groups themselves. Recall that a homogeneous space of a finite group G is a set S 
on which G acts by s i— > x(s) in such a manner that for any given so € 5, { x(sq) \ x £ G } sweeps 
out the entire set. The group elements stabilizing sq form a subgroup H, making it possible to 
identify any s £ S with some coset xH. Thus, 5 itself is identified with the quotient space G/H 
of left cosets of H in G. A transversal for G/H is a set containing exactly one group element 
from each xH coset. By abuse of notation we use the symbol G/H for the transversals as well as 
the quotient space. The right cosets {Hx} xeG also form a quotient space (with respect to the right 
action of G) and this we denote H\G. We examine functions on such spaces in the next section. 

We denote the space of complex valued functions on S = G/H by L{G/H). Any / £ L{G/H) 
extends naturally to a right //-invariant function /| G on G by f^^x) = \H\~ l f(xH). Conversely, 
any g £ L(G) may be restricted to L(G/H) by g [ G / H (xH) = YlheH 9( x ^)- m accordance with 



6 



this correspondence, for z G G we define the left-translate of / G L(G/H) as the function 
/ 2 € L(G/H) given by f z (xH) = f(z~ 1 xH), and the Fourier transform of / as 



f(p) = ^2 P (x)f(xH)= Yl p( x )f( xH ) • I>eo 



(8) 



Clearly, /(p) = f] G (p), and / z (p) = /5(z) • f{p) remains valid for functions on G/H. 

We denote by p [ H the restricted representations p: H —> C dpXdp given by p [ H (h) = p(h). 
While p is always an irreducible representation of G, in general pi H 'is reducible, i.e., 



pi H (h) = U p 



h£H, 



(9) 



where U p is a unitary matrix and r\ runs over some well-defined subset of irreducible representations 
of H, possibly with repeats. If U p = I we say that p is adapted to H or, equivalently, that it is 
expressed in a Gelfand-Tsetlin basis with respect to G/H. In the following we assume that each 
p G 1Z is not only unitary but also ^/-adapted. It is possible to show that one may always choose 
1Z so as to satisfy these conditions. 

For the trivial representation rjtn V (h) = 1 we have rj tT i v (h) = \ H |, hence by the unitarity of 
the Fourier transform over H for any other irreducible we must have Ylh r /(^-) = 0- Plugging ([9]) 
(with Up = I) back in ([8]) then shows that the Fourier transform of functions in L(G/H) have a 
very special form: only those columns of the f{p) matrices are non-zero which correspond to the 
trivial representation of H in ([9]). 

The consequences of this type of sparsity are two-fold. On the one hand, except for the trivial 
case H = e, the sparsty implies that the non-singularity condition required for Kakarala's com- 
pleteness result and derived results such as Theorem [1] are always violated when working over 
homogeneous spaces. The bispectrum, triple correlation and skew spectrum remain useful invari- 
ants, but we can no longer trust that they uniquely determine the original function up to translation. 
On the other hand, the sparsity suggests that the invariants can be computed much faster than 
when we were working over the full group G. 

Letting n p be the multiplicity of the trivial representation in the summation on the right hand 
side of ([9]), each bispectrum component (with the final Cp lP2 omitted) 



b(pi,p 2 ) = {Kpi)®7{P2)) ] C P1P2 0/(p) 

pen 



ffim p 



(10) 



will only have n pi n P2 non-zero rows and a similary small number of non-zero columns. 
Since y{hx)~ 1 H = yx^ 1 hH = yx~ l H for any h G H, the triple correlation 

b(x l7 x 2 ) = ^ f(yx^H)* fiyx^H)* f(yH) 

y&G 

will be a left H x fZ-invariant function, i.e., effectively b G L{H\G x H\G). The summation still 
extends over all of y G G, however, giving a total complexity of \G\ j \ H \ . 

As for the skew spectrum, the first fact to note is that the z index can be restricted to one 
element from each HxH = { h\xhi \ h%,h2 G H } double coset. A transversal for such double 
cosets we denote H\G/H. 
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Theorem 2 Let H be subgroup of a finite group G and let f G L(G/H). Then the skew spectrum 
qf is uniquely determined by its subset of components {q z (p)\p£TZ, z£ H\G/H }. 

Proof. For any h G H, 

r zh (x) = f{xzhH)f{xhH) = f(xzH)f(xH) = r z (x), 
so q zh (p) = r z (p)^J(p) = r(p)^J(p) = q z (p). Now for ti G H 

r h > z (x) = f(xh'zH)f(xH) = f(xh'zH)f(xh'H) = rf ^(x), 
where r z denotes the right-translate r z (x) = r z (xt~ r ). Thus, by the right-translation property 



= £ P (x) fixt- 1 ) = p(*t) m = Yl p( x ) f( x ) 



pit) = f( P ) ■ P (t) 



xeG xeG L x£G 

of the Fourier transform, 

q h 'M = (? z {p)p{h'- l )) ] f{p)=p{h')? z {p) ] 7(p)=P{h')q z {p), 
so qh' z {p) and q z {p) albeit not equal, are related by an invertible linear mapping. ■ 

What the best way to compute q z (p) is strongly depends on G and H. One possible algorithm is 
based on the decomposition 

Rp)= E p(y)®Y.^ h )^y h )= E p(y)®Uv) 

yeG/H v heH yeG/H v 

where the f y are functions on H defined f y (h) = f(yh) and f y are their Fourier transforms 

fy(v)=J2 r l(h)fy(h). 

heH 

This is akin to a Clausen-type "matrix separation of variables" fast Fourier transform (FFT) 
tailored to the G > H > 1 chain. Because / G L(G/H), all but the /^(r/triv) component of f y 
vanish, and / can be computed efficiently by restricting the FFT to the descendants of the fnim™) 
comp onents (see the section on "partial Fourier transforms" in the documentation to SnOB Ko ndor , 
l2006[ ] for details). Letting g be the right-translated function g(x) = f z ~'\x) = f(xz) we can then 
compute g(p) = f(p) piz^ 1 ) for each p and run the FFT backwards to get g y (r]) for each y G G/H. 
Multiplying each of these by the corresponding f(y) yields g y (r])f(y), which is exactly the Fourier 
transform of r z restricted to yH, so one more forward transform yields r z (p), which we can plug 
directly into 0. The exact complexity of this procedure depends on the groups G and H. 
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5 Right invariance 



The right-translate of /: G — > C by z € G is defined f( z \x) = f(xz^ 1 ), and a functional 
f>: / i— > is said to be right-invariant if p(f^) = p(f) for any / and any t £ G. Everything 
that we described in sections [2] and [3] have natural right-invariant analogs. The Fourier transform 
obeys f^\p) = f(p)p(t) and the corresponding invariant power spectrum is q R (p) = f(p) f(p)\ 
which is the Fourier transform of the "right-autocorrelation" q R (x) = SyeG f(v) f( xv )- Similarly, 
the "right-bispectrum" is 



b R (pi,P2) = (f( P i)®f(P2))C l 



P\P2 



0/00 

pen 



which is the Fourier transform of b (x±, X2) = Yl y eG f( x ^v) f( x 2lj) f{y)- For the skew spectrum we 
must change r z to r R (x) = u\ z (x) = f(x) f(zx), and let q R {p) = r R (p) f(p)^, which is the Fourier 
transform of q R = X^yeG f( xv ) f( zxv ) fiu)- The rest of the analysis goes through exactly as in the 
left-invariant case. 

Generalizing section [4] is more interesting, because our choice of G/H over H\G breaks the 
left-right symmetry. For notational convenience, instead of constructing right-invariant functionals 
of / € L(G/H), we discuss the analogous problem of left-invariant functionals of / £ L(H\G). 

Left-translating / G L(H\G) by t € H leaves it invariant, effectively reducing the set of trans- 
formations of interest from G to G/H. In this sense we are in a easier situation than in sectional 
Indeed, despite that the Fourier matrices of / are just as rank deficient as in the previous section, 
in this case Kakarala's completeness result is salvagable. 



Theorem 3 \KakaralA . Upoi . Theorem 3.3.6] Let H be any closed subgroup of a compact group G, 



and let f € L\(H\G) be such that for all p € 1Z, the matrix rank of f(p) is equal to the multiplicity 
of rjtriv in the decomposition of p into irreducible representations of H. Then bf = bfi for some 
f € L\(G) if and only if there exists some t G G such that f = (f] G ) 1 . 

As a corollary, the skew spectrum will all so be complete. However, the skew spectrum is a 
much larger object than before because (a) there is no obvious way to restrict z like in Theorem 
[2] (b) instead of being columns-sparse, the Fourier matrices are row-sparse, hence as long as the 
decomposition of p \ ^contains Tftriv with multiplicity at least one, q z (p) will be a full d p x d p matrix. 



6 Conclusions 

The bispectrum is an elegant way of constructing invariants of functions on finite groups with respect 
to translation, but from a computational point of view it is not necessarily attractive. We discussed 
the theory behind the bispectrum from a new angle, and arrived at a unitarily equivalent set of 
invariants, which we named the skew spectrum. Not only is the skew spectrum easier to compute, it 
also meshes naturally with the structure of Clausen-type fast Fourier transforms, promising efficient 
specialized algorithms for computing it on specific groups or homogeneous spaces of groups. 
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